Me, myself and I: A general theory of non-Markovian time-inconsistent stochastic control for sophisticated agents

نویسندگان

چکیده

We develop a theory for continuous-time non-Markovian stochastic control problems which are inherently time-inconsistent. Their distinguishing feature is that the classical Bellman optimality principle no longer holds. Our formulation cast within framework of controlled forward differential equation, and general objective functional setting. adopt game-theoretic approach to study such problems, meaning we seek subgame perfect Nash equilibrium points. As first novelty this work, introduce motivate refinement definition allows us establish direct rigorous proof an extended dynamic programming principle, in same spirit as theory. This turn system consisting infinite family backward equations analogous HJB equation. prove fundamental, sense its well-posedness both necessary sufficient characterise value function equilibria. final step, provide existence uniqueness result. Some examples extensions our results also presented.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A General Theory of Markovian Time Inconsistent Stochastic Control Problems

We develop a theory for stochastic control problems which, in various ways, are time inconsistent in the sense that they do not admit a Bellman optimality principle. We attach these problems by viewing them within a game theoretic framework, and we look for Nash subgame perfect equilibrium points. For a general controlled Markov process and a fairly general objective functional we derive an ext...

متن کامل

Time Inconsistent Stochastic Control in Continuous Time: Theory

In this paper, which is a continuation of the discrete time paper [4], we develop a theory for continuous time stochastic control problems which, in various ways, are time inconsistent in the sense that they do not admit a Bellman optimality principle. We study these problems within a game theoretic framework, and we look for Nash subgame perfect equilibrium points. For a general controlled con...

متن کامل

Theory of non-Markovian stochastic resonance.

We consider a two-state model of non-Markovian stochastic resonance (SR) within the framework of the theory of renewal processes. Residence time intervals are assumed to be mutually independent and characterized by some arbitrary nonexponential residence time distributions which are modulated in time by an externally applied signal. Making use of a stochastic path integral approach we obtain ge...

متن کامل

Time-Inconsistent Stochastic Linear-Quadratic Control

Abstract. In this paper, we formulate a general time-inconsistent stochastic linear–quadratic (LQ) control problem. The time-inconsistency arises from the presence of a quadratic term of the expected state as well as a state-dependent term in the objective functional. We define an equilibrium, instead of optimal, solution within the class of open-loop controls, and derive a sufficient condition...

متن کامل

Stochastic Impulse Control of Non-Markovian Processes

We consider a class of stochastic impulse control problems of general stochastic processes i.e. not necessarily Markovian. Under fairly general conditions we establish existence of an optimal impulse control. We also prove existence of combined optimal stochastic and impulse control of a fairly general class of diffusions with random coefficients. Unlike, in the Markovian framework, we cannot a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Annals of Applied Probability

سال: 2023

ISSN: ['1050-5164', '2168-8737']

DOI: https://doi.org/10.1214/22-aap1845